CLAIMS 



We Claim: 

1 A computer-implemented method for determining from an input color filter array (CFA) 
5 sampled image, an edge direction, the method comprising: 

calculating for a current missing green pixel, interpolation errors in an East- 
West (EW) direction at known neighboring green pixels, and averaging the EW 
interpolation errors to obtain an EW error; 

calculating for the current missing green pixel, interpolation errors in a North- 
10 South (NS) direction at known neighboring green pixels, and averaging the NS 

interpolation errors to obtain a NS error; and 

selecting a direction indicated by a minimum of the EW error and the NS 
error as the edge direction. 

15 2 The method of claim 1 wherein the selected edge direction, the sampled image, which 
includes a green channel (G) of green pixels, a red channel (R) of red pixels, and a 
blue channel (B) of blue pixels, are used to interpolate missing green pixels at red and 
blue locations in the green channel by: 

for the missing green pixel, interpolating a difference image comprising the 
20 G-B if the missing green pixel is in a blue location, or G-R if the missing green pixel 

is in a red location, in the selected edge direction; 
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in the blue channel, estimating missing blue pixels in green pixel locations 
using linear interpolation of the blue pixels in the blue channel in the selected edge 
direction; and 

in the red channel, estimating the missing red pixels in blue pixel locations 
5 using linear interpolation of the red pixels in the red channel in the selected 

direction, thereby providing an interpolated full green channel in which all missing 
green pixels have an interpolated value. 



3 The method of claim 2 wherein the sampled image and the full green channel are used 
1 0 to correct the green channel by: 

calculating the EW and NS interpolation errors for each pixel in the full green 
channel; 

averaging neighboring EW and NS errors at each green pixel; 
selecting the green local edge direction EW or NS based on the EW and NS 
1 5 average errors having a smallest value; 

estimating the green pixels at blue pixel locations using linear interpolation 
of G-B in the selected direction, and wherein the missing blue pixels are 
interpolated in the selected direction; and 

estimating the green pixels at red pixel locations using linear interpolation of 
20 G-R in the selected direction, and wherein the missing red pixels are interpolated in 

the selected direction. 
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4 The method of claim 2 wherein the sampled image and the full green channel are used 
to interpolate the red and blue pixels to obtain a quincunx sampling by: 

using the full green channel to estimate a local EW or NS edge direction by 
calculating errors in interpolation in EW and NS directions at each pixel; 
5 labeling each pixel's direction as one of EW or NS based on a minimum of 

the EW and NS average errors in a neighborhood of the current green pixel; 

at missing red quincunx samples, interpolating R-G i n t he d irection of the 
label; and 

at missing blue quincunx samples, interpolating B-G in the direction of the 

10 label. 



5 The method of claim 2 wherein the quincunx sampled red and blue channels and the 
full green channel are used to interpolate the red and blue pixels to obtain full red and 
blue channels by: 

15 using the full green channel to estimate a NE or NW edge direction by 

calculating errors in interpolation in NE and NW directions at each pixel; 

labeling each pixel's direction as one of NE or NW based on a minimum of 
NE and NW average errors in a neighborhood of the current green pixel; 

at the missing quincunx samples interpolating R-G in the direction of the 
20 local label; and 

at the missing quincunx samples interpolating B-G in the direction of the 
local label. 
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6 The method of claim 2 wherein corrected high density red, green, and blue channels 
are obtained from the input the full red, green, and blue channels by: 

using the G-R channel to estimate a local EW.NE, NS, or NW edge direction 
by calculating errors in interpolation of the G-R channel in the EW, NE, NS, and 
NW directions at each pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating G-R in the direction of the label; 

adding the red channel to the interpolated G-R to obtain a G R channel; 

using the G-B channel to estimate local EW.NE, NS, or NW edge direction 
by calculating errors in interpolation of the G-B channel in the EW, NE, NS, and 
NW directions at each pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating G-B in the direction of the label; 

adding the blue channel to the interpolated G-B to obtain the G B channel; 
averaging the Gr and Gb channels in order to obtain a new green channel 

(Gnew)i 

calculating R- G ne w channel; 

using R- G new to estimate a local EW.NE, NS, or NW edge direction by 
calculating errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 
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labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating R- G new in the direction of the label; 

adding the new green channel to the interpolated R- G ne w to obtain a new 
5 red channel; 

calculating B- G new ; 

using B- G new to estimate local EW,NE, NS, or NW edge direction by 
calculating the errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

10 labeling each pixel's direction as one of EW, NE, NS, or NW based on a 

minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating B-G new in the direction of the label; and 

adding the new green channel to the interpolated B- G new to obtain a new 
blue channel. 

15 

7 A computer-implemented method for obtaining corrected high-density red (R), green 
(G), and blue (B) channels from interpolated red, green, and blue channels from an 
input color filter array (CFA) sampled image, the method comprising: 
calculating a G-R channel; 
20 using the G-R channel to estimate a local EW,NE, NS, or NW edge direction 

by calculating errors in interpolation of the G-R channel in the EW, NE, NS, and 
NW directions at each pixel; 
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labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating G-R in the direction of the label; 

adding the red channel to the interpolated G-R to obtain a G R channel; 
5 calculating the G-B channel; 

using the G-B channel to estimate local EW.NE, NS, or NW edge direction 
by calculating errors in interpolation of the G-B channel in the EW, NE, NS, and 
NW directions at each pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
1 0 minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating G-B in the direction of the label; 

adding the blue channel to the interpolated G-B to obtain the G B channel; 
averaging the G R and G B channels in order to obtain a new green channel 

(Gnew)l 

15 calculating R- G ne w channel; 

using R- G ne w to estimate a local EW.NE, NS, or NW edge direction by 
calculating errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
20 minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating R- G ne w in the direction of the label; 

adding the new green channel to the interpolated R- G new to obtain a new 
red channel; 
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calculating B- G ne w; 

using B- G ne w to estimate local EW.NE, NS, or NW edge direction by 
calculating the errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating B-G ne w in the direction of the label; and 

adding the new green channel to the interpolated B- G new to obtain a new 
blue channel. 

8 A computer-readable medium containing program instructions for determining from an 
input color filter array (CFA) sampled image, an edge direction, the program 
instructions for: 

calculating for a current missing green pixel, interpolation errors in an East- 
West (EW) direction at known neighboring green pixels, and averaging the EW 
interpolation errors to obtain an EW error; 

calculating for the current missing green pixel, interpolation errors in a North- 
South (NS) direction at known neighboring green pixels, and averaging the NS 
interpolation errors to obtain a NS error; and 

selecting a direction indicated by a minimum of the EW error and the NS 
error as the edge direction. 
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9 The computer-readable medium of claim 8 wherein the selected edge direction, the 
sampled image, which includes a green channel (G) of green pixels, a red channel (R) 
of red pixels, and a blue channel (B) of blue pixels, are used to interpolate missing 
green pixels at red and blue locations in the green channel by: 

for the missing green pixel, interpolating a difference image comprising the 
G-B if the missing green pixel is in a blue location, or G-R if the missing green pixel 
is in a red location, in the selected edge direction; 

in the blue channel, estimating missing blue pixels in green pixel locations 
using linear interpolation of the blue pixels in the blue channel in the selected edge 
direction; and 

in the red channel, estimating the missing red pixels in blue pixel locations 
using linear interpolation of the red pixels in the red channel in the selected 
direction, thereby providing an interpolated full green channel in which all missing 
green pixels have an interpolated value. 

10 The computer-readable medium of claim 9 wherein the sampled image and the full 
green channel are used to correct the green channel by: 

calculating the EW and NS interpolation errors for each pixel in the full green 
channel; 

averaging neighboring EW and NS errors at each green pixel; 
selecting the green local edge direction EW or NS based on the EW and NS 
average errors having a smallest value; 
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estimating the green pixels at blue pixel locations using linear interpolation 
of G-B in the selected direction, and wherein the missing blue pixels are 
interpolated in the selected direction; and 

estimating the green pixels at red pixel locations using linear interpolation of 
5 G-R in the selected direction, and wherein the missing red pixels are interpolated in 

the selected direction. 

1 1 The computer-readable medium of claim 9 wherein the input sampled image and the 
full green channel are used to interpolate the red and blue pixels to obtain a quincunx 
10 sampling by: 

using the full green channel to estimate a local EW or NS edge direction by 
calculating errors in interpolation in EW and NS directions at each pixel; 

labeling each pixel's direction as one of EW or NS based on a minimum of 
the EW and NS average errors in a neighborhood of the current green pixel; 
15 at missing red quincunx samples, interpolating R-G i n the d irection of the 

label; and 

at missing blue quincunx samples, interpolating B-G in the direction of the 

label. 

20 12 The computer-readable medium of claim 9 wherein the quincunx sampled red and blue 
channels and the full green channel are used to interpolate the red and blue pixels to 
obtain full red and blue channels by: 
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using the full green channel to estimate a NE or NW edge direction by 
calculating errors in interpolation in NE and NW directions at each pixel; 

labeling each pixel's direction as one of NE or NW based on a minimum of 
NE and NW average errors in a neighborhood of the current green pixel; 
5 at the missing quincunx samples interpolating R-G in the direction of the 

local label; and 

at the missing quincunx samples interpolating B-G in the direction of the 
local label. 



10 13 The computer-readable medium of claim 9 wherein corrected high density red, green, 
and blue channels are obtained from the input the full red, green, and blue channels 
by: 

using the G-R channel to estimate a local EW.NE, NS, or NW edge direction 
by calculating errors in interpolation of the G-R channel in the EW, NE, NS, and 
1 5 NW directions at each pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating G-R in the direction of the label; 

adding the red channel to the interpolated G-R to obtain a G R channel; 
20 using the G-B channel to estimate local EW.NE, NS, or NW edge direction 

by calculating errors in interpolation of the G-B channel in the EW, NE, NS, and 
NW directions at each pixel; 
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labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating G-B in the direction of the label; 

adding the blue channel to the interpolated G-B to obtain the G B channel; 
averaging the Gr and G B channels in order to obtain a new green channel 

(Gnew); 

calculating R- G ne w channel; 

using R- G ne w to estimate a local EW.NE, NS, or NW edge direction by 
calculating errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating R- G new in the direction of the label; 

adding the new green channel to the interpolated R- G ne w to obtain a new 
red channel; 

calculating B- G ne w; 

using B- G ne w to estimate local EW.NE, NS, or NW edge direction by 
calculating the errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating B-G new in the direction of the label; and 
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adding the new green channel to the interpolated B- G ne w to obtain a new 
blue channel. 

14 An electronic device, comprising: 
5 an input color filter array (CFA) for filtering light at a time of image capture; 

a charge coupled device (CCD) for sensing the filitered light to produce a sampled 

image; 

a processor for processing the sampled image; and 

an edge directed demosaicing algorithm executed by the processor for: 

10 calculating for a current missing green pixel, interpolation errors in an East- 

West (EW) direction at known neighboring green pixels, and averaging the EW 
interpolation errors to obtain an EW error; 

calculating for the current missing green pixel, interpolation errors in a North- 
South (NS) direction at known neighboring green pixels, and averaging the NS 

15 interpolation errors to obtain a NS error; and 

selecting a direction indicated by a minimum of the EW error and the NS 
error as the edge direction. 

15 The electronic device of claim 14 wherein the selected edge direction, the sampled 
20 image, which includes a green channel (G) of green pixels, a red channel (R) of red 

pixels, and a blue channel (B) of blue pixels, are used to interpolate missing green 
pixels at red and blue locations in the green channel by: 
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for the missing green pixel, interpolating a difference image comprising the 
G-B if the missing green pixel is in a blue location, or G-R if the missing green pixel 
is in a red location, in the selected edge direction; 

in the blue channel, estimating missing blue pixels in green pixel locations 
5 using linear interpolation of the blue pixels in the blue channel in the selected edge 

direction; and 

in the red channel, estimating the missing red pixels in blue pixel locations 
using linear interpolation of the red pixels in the red channel in the selected 
direction, thereby providing an interpolated full green channel in which all missing 
1 0 green pixels have an interpolated value. 



16 The electronic device of claim 15 wherein the sampled image and the full green 
channel are used to correct the green channel by: 

calculating the EW and NS interpolation errors for each pixel in the full green 
15 channel; 

averaging neighboring EW and NS errors at each green pixel; 
selecting the green local edge direction EW or NS based on the EW and NS 
average errors having a smallest value; 

estimating the green pixels at blue pixel locations using linear interpolation 
20 of G-B in the selected direction, and wherein the missing blue pixels are 

interpolated in the selected direction; and 
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estimating the green pixels at red pixel locations using linear interpolation of 
G-R in the selected direction, and wherein the missing red pixels are interpolated in 
the selected direction. 

5 17 The electronic device of claim 15 wherein the sampled image and the full green 
channel are used to interpolate the red and blue pixels to obtain a quincunx 
sampling by: 

using the full green channel to estimate a local EW or NS edge direction by 
calculating errors in interpolation in EW and NS directions at each pixel; 
10 labeling each pixel's direction as one of EW or NS based on a minimum of 

the EW and NS average errors in a neighborhood of the current green pixel; 

at missing red quincunx samples, interpolating R-G i n t he d irection of the 
label; and 

at missing blue quincunx samples, interpolating B-G in the direction of the 

15 label. 

18 The electronic device of claim 15 wherein the quincunx sampled red and blue 
channels and the full green channel are used to interpolate the red and blue pixels 
to obtain full red and blue channels by: 
20 using the full green channel to estimate a NE or NW edge direction by 

calculating errors in interpolation in NE and NW directions at each pixel; 

labeling each pixel's direction as one of NE or NW based on a minimum of 
NE and NW average errors in a neighborhood of the current green pixel; 
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at the missing quincunx samples interpolating R-G in the direction of the 
local label; and 

at the missing quincunx samples interpolating B-G in the direction of the 
local label. 

5 

19 The electronic device of claim 15 wherein corrected high density red, green, and 
blue channels are obtained from the input the full red, green, and blue channels by: 
using the G-R channel to estimate a local EW.NE, NS, or NW edge direction 
by calculating errors in interpolation of the G-R channel in the EW, NE, NS, and 
10 NW directions at each pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating G-R in the direction of the label; 

adding the red channel to the interpolated G-R to obtain a G R channel; 
15 using the G-B channel to estimate local EW.NE, NS, or NW edge direction 

by calculating errors in interpolation of the G-B channel in the EW, NE, NS, and 
NW directions at each pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
20 interpolating G-B in the direction of the label; 

adding the blue channel to the interpolated G-B to obtain the G B channel; 
averaging the G R and G B channels in order to obtain a new green channel 

(Gnew)> 
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calculating R- G ne w channel; 

using R- G ne w to estimate a local EW.NE, NS, or NW edge direction by 
calculating errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 
interpolating R- G ne w in the direction of the label; 

adding the new green channel to the interpolated R- G ne w to obtain a new 
red channel; 

calculating B- G ne w; 

using B- G new to estimate local EW.NE, NS, or NW edge direction by 
calculating the errors in interpolation in the EW, NE, NS, and NW directions at each 
pixel; 

labeling each pixel's direction as one of EW, NE, NS, or NW based on a 
minimum of the average errors in a neighborhood of the corresponding pixel; 

interpolating B-G ne w in the direction of the label; and 

adding the new green channel to the interpolated B- G ne w to obtain a new 
blue channel. 
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